Behind the Machine's Gaze: Biologically Constrained Neural Networks Exhibit Human-like Visual Attention

By and large, existing computational models of visual attention tacitly assume perfect vision and full access to the stimulus and thereby deviate from foveated biological vision. Moreover, modelling top-down attention is generally reduced to the integration of semantic features without incorporating the signal of a high-level visual tasks that have shown to partially guide human attention. We propose the Neural Visual Attention (NeVA) algorithm to generate visual scanpaths in a top-down manner. With our method, we explore the ability of neural networks on which we impose the biological constraints of foveated vision to generate human-like scanpaths. Thereby, the scanpaths are generated to maximize the performance with respect to the underlying visual task (i.e., classification or reconstruction). Extensive experiments show that the proposed method outperforms state-of-the-art unsupervised human attention models in terms of similarity to human scanpaths. Additionally, the flexibility of the framework allows to quantitatively investigate the role of different tasks in the generated visual behaviours. Finally, we demonstrate the superiority of the approach in a novel experiment that investigates the utility of scanpaths in real-world applications, where imperfect viewing conditions are given

FastAMI -- a Monte Carlo Approach to the Adjustment for Chance in Clustering Comparison Metrics

Clustering is at the very core of machine learning, and its applications proliferate with the increasing availability of data. However, as datasets grow, comparing clusterings with an adjustment for chance becomes computationally difficult, preventing unbiased ground-truth comparisons and solution selection. We propose FastAMI, a Monte Carlo-based method to efficiently approximate the Adjusted Mutual Information (AMI) and extend it to the Standardized Mutual Information (SMI). The approach is compared with the exact calculation and a recently developed variant of the AMI based on pairwise permutations, using both synthetic and real data. In contrast to the exact calculation our method is fast enough to enable these adjusted information-theoretic comparisons for large datasets while maintaining considerably more accurate results than the pairwise approach.Comment: Accepted at AAAI 202

Tactile myography: an off-line assessment on intact subjects and one upper-limb disabled

Castellini C, Kõiva R, Pasluosta C, Viegas C, Eskofier BM. Tactile myography: an off-line assessment on intact subjects and one upper-limb disabled. Technologies / SI: Assistive Robotics. 2018;6(2): 38.Human-machine interfaces to control prosthetic devices still suffer from scarce dexterity and low reliability; for this reason, the community of assistive robotics is exploring novel solutions to the problem of myocontrol. In this work, we present experimental results pointing in the direction that one such method, namely Tactile Myography (TMG), can improve the situation. In particular, we use a shape-conformable high-resolution tactile bracelet wrapped around the forearm/residual limb to discriminate several wrist and finger activations performed by able-bodied subjects and a trans-radial amputee. Several combinations of features/classifiers were tested to discriminate among the activations. The balanced accuracy obtained by the best classifier/feature combination was on average 89.15% (able-bodied subjects) and 88.72% (amputated subject); when considering wrist activations only, the results were on average 98.44% for the able-bodied subjects and 98.72% for the amputee. The results obtained from the amputee were comparable to those obtained by the able-bodied subjects. This suggests that TMG is a viable technique for myoprosthetic control, either as a replacement of or as a companion to traditional surface electromyography

Achieving Efficient and Realistic Full-Radar Simulations and Automatic Data Annotation by exploiting Ray Meta Data of a Radar Ray Tracing Simulator

In this work a novel radar simulation concept is introduced that allows to simulate realistic radar data for Range, Doppler, and for arbitrary antenna positions in an efficient way. Further, it makes it possible to automatically annotate the simulated radar signal by allowing to decompose it into different parts. This approach allows not only almost perfect annotations possible, but also allows the annotation of exotic effects, such as multi-path effects or to label signal parts originating from different parts of an object. This is possible by adapting the computation process of a Monte Carlo shooting and bouncing rays (SBR) simulator. By considering the hits of each simulated ray, various meta data can be stored such as hit position, mesh pointer, object IDs, and many more. This collected meta data can then be utilized to predict the change of path lengths introduced by object motion to obtain Doppler information or to apply specific ray filter rules in order obtain radar signals that only fulfil specific conditions, such as multiple bounces or containing specific object IDs. Using this approach, perfect and otherwise almost impossible annotations schemes can be realized.Comment: Accepted for IEEE RadarConf 202

A New Labeling Approach for Proportional Electromyographic Control

Different control strategies are available for human machine interfaces based on electromyography (EMG) to map voluntary muscle signals to control signals of a remote controlled device. Complex systems such as robots or multi-fingered hands require a natural commanding, which can be realized with proportional and simultaneous control schemes. Machine learning approaches and methods based on regression are often used to realize the desired functionality. Training procedures often include the tracking of visual stimuli on a screen or additional sensors, such as cameras or force sensors, to create labels for decoder calibration. In certain scenarios, where ground truth, such as additional sensor data, can not be measured, e.g., with people suffering from physical disabilities, these methods come with the challenge of generating appropriate labels. We introduce a new approach that uses the EMG-feature stream recorded during a simple training procedure to generate continuous labels. The method avoids synchronization mismatches in the labels and has no need for additional sensor data. Furthermore, we investigated the influence of the transient phase of the muscle contraction when using the new labeling approach. For this purpose, we performed a user study involving 10 subjects performing online 2D goal-reaching and tracking tasks on a screen. In total, five different labeling methods were tested, including three variations of the new approach as well as methods based on binary labels, which served as a baseline. Results of the evaluation showed that the introduced labeling approach in combination with the transient phase leads to a proportional command that is more accurate than using only binary labels. In summary, this work presents a new labeling approach for proportional EMG control without the need of a complex training procedure or additional sensors

Electromyography for teleoperated tasks in weightlessness

The cooperation between robots and astronauts will become a core element of future space missions. This is accompanied by the demand for suitable input devices. An interface based on electromyography (EMG) represents a small, light and wearable device to generate a continuous 3D control signal from voluntarily muscle activation of the operator's arm. We analyzed the influence of microgravity on task performance during a 2D task on a screen. Six subjects performed aiming and tracking tasks in parabolic flights. Three different levels of fixation -- fixed feet using foot straps, semi-free by using a foot rail, and free-floating feet -- were tested to investigate how much user fixation is required to operate via the interface. The user study showed that weightlessness affects the usage of the interface only to a small extent. Success rates between 89% and 96% were reached within all conditions during microgravity. A significant effect between 0G and 1G could not be identified for the test series of fixed and semi-free feet, while free-floating feet showed significantly worse results in fine and gross motion times in 0G compared to ground tests (with success rates of 92% for 0G and 99% for 1G). Further adaptation to the altered proprioception may be needed here. Hence, foot rails as already mounted in the ISS would be sufficient to use the interface in weightlessness. Low impact of microgravity, high success rates, and an easy handling of the system, indicates a high potential of an EMG-based interface for teleoperation in space

Using wearable inertial sensors to compare different versions of the dual task paradigm during walking

The dual task paradigm (DTP), where performance of a walking task co-occurs with a cognitive task to assess performance decrement, has been controversially mooted as a more suitable task to test safety from falls in outdoor and urban environments than simple walking in a hospital corridor. There are a variety of different cognitive tasks that have been used in the DTP, and we wanted to assess the use of a secondary task that requires mental tracking (the alternate letter alphabet task) against a more automatic working memory task (counting backward by ones). In this study we validated the x-io x-IMU wearable inertial sensors, used them to record healthy walking, and then used dynamic time warping to assess the elements of the gait cycle. In the timed 25 foot walk (T25FW) the alternate letter alphabet task lengthened the stride time significantly compared to ordinary walking, while counting backward did not. We conclude that adding a mental tracking task in a DTP will elicit performance decrement in healthy volunteers

Revisiting QRS detection methodologies for portable, wearable, battery-operated, and wireless ECG systems

Cardiovascular diseases are the number one cause of death worldwide. Currently, portable battery-operated systems such as mobile phones with wireless ECG sensors have the potential to be used in continuous cardiac function assessment that can be easily integrated into daily life. These portable point-of-care diagnostic systems can therefore help unveil and treat cardiovascular diseases. The basis for ECG analysis is a robust detection of the prominent QRS complex, as well as other ECG signal characteristics. However, it is not clear from the literature which ECG analysis algorithms are suited for an implementation on a mobile device. We investigate current QRS detection algorithms based on three assessment criteria: 1) robustness to noise, 2) parameter choice, and 3) numerical efficiency, in order to target a universal fast-robust detector. Furthermore, existing QRS detection algorithms may provide an acceptable solution only on small segments of ECG signals, within a certain amplitude range, or amid particular types of arrhythmia and/or noise. These issues are discussed in the context of a comparison with the most conventional algorithms, followed by future recommendations for developing reliable QRS detection schemes suitable for implementation on battery-operated mobile devices.Mohamed Elgendi, Björn Eskofier, Socrates Dokos, Derek Abbot

Design and validation of a multi-task, multi-context protocol for real-world gait simulation

Background: Measuring mobility in daily life entails dealing with confounding factors arising from multiple sources, including pathological characteristics, patient specific walking strategies, environment/context, and purpose of the task. The primary aim of this study is to propose and validate a protocol for simulating real-world gait accounting for all these factors within a single set of observations, while ensuring minimisation of participant burden and safety. Methods: The protocol included eight motor tasks at varying speed, incline/steps, surface, path shape, cognitive demand, and included postures that may abruptly alter the participants’ strategy of walking. It was deployed in a convenience sample of 108 participants recruited from six cohorts that included older healthy adults (HA) and participants with potentially altered mobility due to Parkinson’s disease (PD), multiple sclerosis (MS), proximal femoral fracture (PFF), chronic obstructive pulmonary disease (COPD) or congestive heart failure (CHF). A novelty introduced in the protocol was the tiered approach to increase difficulty both within the same task (e.g., by allowing use of aids or armrests) and across tasks. Results: The protocol proved to be safe and feasible (all participants could complete it and no adverse events were recorded) and the addition of the more complex tasks allowed a much greater spread in walking speeds to be achieved compared to standard straight walking trials. Furthermore, it allowed a representation of a variety of daily life relevant mobility aspects and can therefore be used for the validation of monitoring devices used in real life. Conclusions: The protocol allowed for measuring gait in a variety of pathological conditions suggests that it can also be used to detect changes in gait due to, for example, the onset or progression of a disease, or due to therapy. Trial registration: ISRCTN—12246987